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Remarks 

1 . Claims 1 , 2, 4-22, 25-37, and 40-47 liave been examined and rejected. Tlnis 
Office action is responsive to the amendment filed on 8/3/09, which has been entered in 
the above identified application. 



Claim Objections 

2. The correction(s) to claim 12 have been approved, and the objection to the claim 
is withdrawn. 

Claim 39 has been canceled and thus, the objection to the claims is withdrawn. 



3. Claim 34 is objected to because of the following informalities: 

a. On [line 3] of claim 34, Examiner suggests changing "the date column" to - 

-a date column--. 
Appropriate correction is required. 



Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the phor art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary sl<ill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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5. Claim 1 , 2, 4-22, 26-37, and 40-47 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Vronay et al (Pub. No. US 2003/0156138 A1) in view of Temple 
("The Complete Idiot's Guide to Microsoft Outlool< 2000", May 1999), and furtlier in view 
of Adcocl< et al (Pub. No. US 2004/0125150 Al). 

Claims 1,2, 4-19, 42 

5-1 . Regarding claim 1 , Vronay teaches the claim comprising a computer readable 
storage medium; and computer-readable program instructions embodied in the medium, 
the computer-readable program instructions including: first instructions for receiving 
manual entry of events and generating a calendar view that represents time in calendar 
format and visually associates events with respective periods of time, the calendar view 
including at least one manually entered event scheduled at a future time, by disclosing a 
calendar-based user interface that improves user accessibility of information from a 
computer [paragraph 1]. The calendar user interface system would provide and include 
standard calendar operations, similar to the calendar in numerous conventional 
calendar programs [paragraph 35]. Conventional computer calendars allow for user- 
specified appointments, meetings, etc. to be added or entered manually [paragraph 5]. 
These events are marked on the calendar to allow users to easily track important events 
[paragraph 42]. The user computer activities may be in the future [paragraph 38]. The 
user computer activity must involve manual creation as described in [paragraphs 35, 5] 
since if monitoring of events is strictly done without user input and based solely on data 
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collection of activities carried out on a computing device, there would be no way for the 
computer to create future events. 

Vronay teaches wherein at least one of the events is created and represented in 
the calendar view independent of any digital media files, by disclosing that events are 
marked on the calendar to allow users to easily track important events [paragraphs 39- 
42]. 

Vronay teaches second instructions for generating a media view that provides 
access to digital media files and associates digital media files with a period of time, by 
disclosing simultaneously presenting the calendar view with a list of times and 
corresponding accessible media [paragraph 65, figure 11]. 

Vronay does not expressly teach the calendar view including at least one 
manually entered past event. Temple discloses adding appointments to a calendar in 
Microsoft Outlook 2000 [page 196, Adding an Appointment]. Users can enter the date 
and time for an appointment, which may be a past date [page 198, When?; page 200, 
Other Ways to Add Appointments]. Since Vronay discloses providing and including 
standard calendar operations, similar to the calendar in numerous conventional 
calendar programs [Vronay, paragraph 35], it would have been obvious to one of 
ordinary skill in the art at the time the invention was made to allow users to manual 
enter an event in the past, as taught by Temple. This would provide added flexibility in 
scheduling events. 

Although Vronay discloses simultaneously presenting the calendar view with a 
list of times and corresponding accessible media [Vronay, paragraph 65, figure 11], 
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Vronay does not expressly teach wherein the first and second instructions operate 
concurrently to generate a timeline view that combines the calendar view and the media 
view such that multiple media file representations are enabled to be displayed in a 
corresponding period of time segment of the timeline view along with a text identification 
of an event associated with the multiple media file representations. Adcock discloses a 
calendar based graphical user interface for displaying digital images [paragraph 1]. 
Graphical objects representing digital images are displayed within a calendar view 
having a timeline [figures 4, 5]. Digital images are accessible for detailed viewing or 
editing by selection of a displayed graphical object in the calendar [paragraph 35]. 
Images for an event may be grouped together [paragraph 37] and associated with an 
event identifier /joaragfrap/? 40]. Additionally, event groups in the graphical object display 
window may be separated/identified by a placeholder containing information for the 
associated event [paragraph 42]. This allows users to more efficiently browse images 
[paragraph 3]. Since Vronay discloses the need to better locate and retrieve computer 
information such as files, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to use the interface of Adcock for browsing the 
calendar-based interface of Vronay. This would allow users to more efficiently browse 
images. 

5-2. Regarding claim 2, Vronay, Temple, and Adcock disclose the product of claim 1 , 
wherein the second instructions for generating the media view associate digital media 
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files witli event information, by disclosing associated digital images with events [Adcock, 
paragraph 37]. 

5-3. Regarding claim 4, Vronay, Temple, and Adcock disclose the product of claim 1 , 
wherein the first and second instructions operate concurrently to generate, in the 
timeline view, a timeline associated with the media view, by disclosing [Adcock, figures 
4, 5]. 

5-4. Regarding claim 5, Vronay, Temple, and Adcock disclose the product of claim 1 , 
wherein the first and second instructions operate concurrently to generate, in the 
timeline view, a timeline associated with the calendar view and the media view, by 
disclosing [Adcock, figures 4, 5]. 

5-5. Regarding claim 6, Vronay, Temple, and Adcock disclose the product of claim 1 , 
wherein said first instructions are configured to receive manual entry of events and store 
metadata respectively associated with the events, by disclosing that metadata may be 
associated with certain events based on computer activity [Vronay, paragrapli 37]. 
Information stored in a calendar system database is utilized as well as information 
determined by similarity and chunking system to display different levels of time-based 
information relating the user computer activities and files [Vronay, paragrapti 33]. 

Vronay, Temple, and Adcock disclose wherein the first and second instructions 
operate concurrently to correlate respective metadata information of the media files and 
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calendar events, by disclosing displaying digital images based on time the digital image 
was created [Adcock, paragraph 32]. 

5-6. Regarding claim 7, Vronay, Temple, and Adcock disclose the product of claim 1 , 
wherein said first instructions are configured to receive manual entry of events and store 
metadata respectively associated with the events, by disclosing that metadata may be 
associated with certain events based on computer activity [Vronay, paragraph 37]. 
Information stored in a calendar system database is utilized as well as information 
determined by similarity and chunking system to display different levels of time-based 
information relating the user computer activities and files [Vronay, paragraph 33]. 

Vronay, Temple, and Adcock teach wherein the first and second instructions 
operate concurrently to combine previously distinct metadata information of one of the 
media files and a relevant calendar event, respectively, the relevant calendar event 
being manually created and represented in the calendar view independent of any digital 
media files, by disclosing allowing the user to group digital images with events [Adcock, 
paragraph 39]. 

5-7. Regarding claim 8, Vronay, Temple, and Adcock disclose the product of claim 7, 
wherein the first and second instructions operate concurrently to store the combined 
metadata information into the metadata information of the media file, by disclosing that 
metadata can be added to the files [Vronay, paragraphs 60-61]. 
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5-8. Regarding claim 9, Vronay, Temple, and Adcock discloses the product of claim 8, 
wherein the first and second instructions operate concurrently to display, in the media 
view, an item of information in the metadata as a title for a group of media files having 
the same metadata as used in the title, by disclosing searching for and displaying 

matched items under a title representative of the metadata searched for such as 'Dad' 
[Vronay, paragraph 55, figure 7] or a specific date [Vronay, figure 1 1; Adcocl<, 
paragrapt) 36]. 

5-9. Regarding claim 10, Vronay, Temple, and Adcock disclose the product of claim 
9, further comprising third instructions for searching the calendar view and the media 
view in terms of time period, by disclosing searching based on dates [Vronay, figure 5; 
Adcock, paragraph 36]. 

5-1 0. Regarding claim 1 1 , Vronay, Temple, and Adcock disclose the product of claim 
9, further comprising third instructions for searching the calendar view and the media 
view in terms of any combination of metadata information, by disclosing searching 
based on various metadata [Vronay, figures 6, 8, 9]. 

5-1 1 . Regarding claim 1 2, Vronay, Temple, and Adcock disclose the product of claim 
1 , wherein the first instructions also generate an indicator for a current time, by 
disclosing providing information visualizations so the user can distinguish between 
different days such as past days, a current day, and future days [Vronay, paragraph 37]. 
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5-1 2. Regarding claim 1 3, Vronay, Temple, and Adcock disclose the product of claim 
1 , wherein the first instructions also generate a delineation between past time and future 
time, by disclosing providing information visualizations so the user can distinguish 
between different days such as past days, a current day, and future days [Vronay, 
paragraphs 37-39]. 

5-1 3. Regarding claim 1 4, Vronay, Temple, and Adcock disclose the product of claim 
1 , wherein the second instructions associate digital media files with a period of time 
based upon information associated with the digital media file, by disclosing including 
information for a computer files such as when the file was created [Vronay, paragraph 
25; Adcock, paragraph 32]. 

5-14. Regarding claim 1 5, Vronay, Temple, and Adcock disclose the product of claim 
1 , wherein the second instructions provide a user a presentation mode to access the 
digital media files, by disclosing that digital images are accessible for detailed viewing or 
editing by selection of a displayed graphical object [Adcock, paragraph 35]. 

5-1 5. Regarding claim 1 6, Vronay, Temple, and Adcock disclose the product of claim 
1 , wherein the second instructions generate a media view that associates digital media 
files with a past period of time, by disclosing that the user may modify the date for which 
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a digital image is associated [Adcock, paragraph 61] and view a history of a selected 
date [Adcock, paragraph 36]. 

5-1 6. Regarding claim 1 7, Vronay, Temple, and Adcock disclose the product of claim 
1 , wherein the first instructions generate a calendar view that associates events with 
respective future periods of time, by disclosing that the user may edit the days 
encompassing an event [Adcock, paragraph 39]. 

5-1 7. Regarding claim 18, Vronay, Temple, and Adcock disclose the product of claim 
1 , wherein the second instructions for generating a media view that provides access to 
the media files within a period in time further generates instruction that adjusts a size of 
a period of time view according to the amount of the media files in the period of time, by 
disclosing that calendar views are resized based on the number of digital images 
[Adcock, paragraph 46]. 

5-1 8. Regarding claim 1 9, Vronay, Temple, and Adcock disclose the product of claim 
1 8, wherein the second instructions adjust the size of the period of time view so that all 
the media files within a period of time are visible, by disclosing resizing calendar views 
based on the number of digital images [Adcock, paragraph 46; figures 5, 7-12]. 

5-1 9. Regarding claim 42, Vronay, Temple, and Adcock disclose the product of claim 
6, wherein the first and second instructions operate concurrently to automatically 
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correlate respective metadata information of the media file and the at least one calendar 
event, by disclosing automatically associating digital images with an event or date 
[Adcock, paragraph 39]. 

Claims 20,21,43 

5-20. Regarding claim 20, Vronay discloses a method comprising: receiving manual 
input creating an event in a media diary application, by disclosing a calendar-based 
user interface that improves user accessibility of information from a computer 
[paragraph 1]. Users may specify appointments, meetings, etc. [paragraph 5/ which are 
marked on the calendar to allow users to easily track important events [paragraph 42]. 

Vronay teaches receiving, in the media diary application, a digital media file 
having metadata associated with the digital media file, the media diary application being 
configured to represent time in calendar format and visually associate events with 
respective periods of time, at least one past event being created and represented in the 
calendar format independent of any digital media files, by disclosing retrieving 
information about computer files [paragraph 26]. Users may specify appointments, 
meetings, etc. [paragraph 5/ which are marked on the calendar, whether in the past or 
future, to allow users to easily track important events [paragraphs 39-42]. 

Vronay teaches providing a user access to the digital media file via a media view 
that displays a representation of the digital media file in connection with a time element 
of the metadata, by disclosing simultaneously presenting the calendar view with a list of 
times and corresponding accessible media [paragraph 65, figure 11]. 
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The calendar view allows for manual entry of future events since standard 
calendar operations are provided [Vronay, paragraph 35] that include user-specified 
appointments, meetings, etc. to be added or entered manually [Vronay, paragraph 5]. 
These events are marked on the calendar to allow users to easily track important events 
[Vronay, paragraph 42]. The user computer activities may be in the future [Vronay, 
paragraph 38]. The user computer activity must involve manual creation as described in 
[Vronay, paragraphs 35, 5] since if monitoring of events is strictly done without user 
input and based solely on data collection of activities carried out on a computing device, 
there would be no way for the computer to create future events. 

Although Vronay discloses that events are marked on the calendar to allow users 
to easily track important events [Vronay, paragraphs 39-42], Vronay does not expressly 
teach the calendar view including at least one manually entered past event. Temple 
discloses adding appointments to a calendar in Microsoft Outlook 2000 [page 196, 
Adding an Appointment]. Users can enter the date and time for an appointment, which 
may be a past date [page 198, When?; page 200, Other Ways to Add Appointments]. 
Since Vronay discloses providing and including standard calendar operations, similar to 
the calendar in numerous conventional calendar programs [Vronay, paragraph 35], it 
would have been obvious to one of ordinary skill in the art at the time the invention was 
made to allow users to manual enter an event in the past, as taught by Temple. This 
would provide added flexibility in scheduling events. 

Although Vronay discloses simultaneously presenting the calendar view with a 
list of times and corresponding accessible media [Vronay, paragraph 65, figure 11], 
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Vronay does not expressly teach the media view being generated in a timeline view that 
combines the media view with a calendar view such that multiple media file 
representations are enabled to be displayed in a corresponding period of time segment 
of the timeline view along with a text identification of an event associated with the 
multiple media file representations. Adcock discloses a calendar based graphical user 
interface for displaying digital images [paragraph 1]. Graphical objects representing 
digital images are displayed within a calendar view having a timeline [figures 4, 5]. 
Digital images are accessible for detailed viewing or editing by selection of a displayed 
graphical object in the calendar [paragraph 35]. Images for an event may be grouped 
together [paragraph 37] and associated with an event identifier [paragraph 40]. 
Additionally, event groups in the graphical object display window may be 
separated/identified by a placeholder containing information for the associated event 
[paragraph 42]. This allows users to more efficiently browse images [paragraph 3]. 
Since Vronay discloses the need to better locate and retrieve computer information 
such as files, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to use the interface of Adcock for browsing the calendar-based 
interface of Vronay. This would allow users to more efficiently browse images. 

5-21 . Regarding claim 21 , Vronay, Temple, and Adcock disclose the method of claim 
20, further comprising correlating the metadata in the digital media file with distinct 
event metadata information for an event created and represented in the calendar format 
independent of any digital media files, said correlating being prior to providing a user 
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access to the media file via a media view, by disclosing associating events and media 
files [Vronay, paragraph 21]. 

5-22. Regarding claim 43, Vronay, Temple, and Adcock disclose the method of claim 
21, wherein said correlating the metadata includes automatically correlating the 
metadata in the digital media file with distinct event metadata event information for an 
event created and represented in the calendar format independent of any digital media 
files, by disclosing automatically associating digital images with an event or date 
[Adcock, paragraph 39]. 

Claims 22, 44 

5-23. Regarding claim 22, Vronay discloses a method comprising: receiving manual 
input creating an event in a media diary application, by disclosing a calendar-based 
user interface that improves user accessibility of information from a computer 
[paragraph 1]. Users may specify appointments, meetings, etc. [paragraph 57 which are 
marked on the calendar to allow users to easily track important events [paragraph 42]. 

Vronay teaches receiving a digital media file having metadata associated with the 
digital media file, by disclosing retrieving information about computer files [paragraph 
26]. 

Vronay teaches transmitting the file, automatically, to the media diary application, 
the media diary application associating the digital media file with a period in time based 
on the metadata and being configured to represent time in calendar format and 
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associate events with respective periods of time, at least one past event being created 
and represented in the calendar view independent of any digital media files, by 
disclosing associating events and media files [paragraph 21]. Users may specify 
appointments, meetings, etc. [paragraph 5/ which are marked on the calendar, whether 
in the past or future, to allow users to easily track important events [paragraphs 39-42]. 

Vronay teaches providing a user access to the digital media file via a media view 
that displays a representation of the digital media item in connection with the period of 
time, by disclosing that photos may be searched for and accessed [paragraph 65; figure 
11]. 

The calendar view allows for manual entry of future events since standard 
calendar operations are provided [paragraph 35] that include user-specified 
appointments, meetings, etc. to be added or entered manually [paragraph 5]. These 
events are marked on the calendar to allow users to easily track important events 
[paragraph 42]. The user computer activities may be in the future [paragraph 38]. The 
user computer activity must involve manual creation as described in [paragraphs 35, 5] 
since if monitoring of events is strictly done without user input and based solely on data 
collection of activities carried out on a computing device, there would be no way for the 
computer to create future events. 

Although Vronay discloses that events are marked on the calendar to allow users 
to easily track important events [paragraphs 39-42], Vronay does not expressly teach 
the calendar view including at least one manually entered past event. Temple discloses 
adding appointments to a calendar in Microsoft Outlook 2000 [page 196, Adding an 
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Appointment]. Users can enter the date and time for an appointment, wliicli may be a 
past date [page 198, When?; page 200, Other Ways to Add Appointments]. Since 
Vronay discloses providing and including standard calendar operations, similar to the 
calendar in numerous conventional calendar programs [Vronay, paragraph 35], it would 
have been obvious to one of ordinary skill in the art at the time the Invention was made 
to allow users to manual enter an event in the past, as taught by Temple. This would 
provide added flexibility in scheduling events. 

Although Vronay discloses simultaneously presenting the calendar view with a 
list of times and corresponding accessible media [Vronay, paragraph 65, figure 11], 
Vronay does not expressly teach the media view being generated in a timeline view that 
combines the media view with a calendar view such that multiple media file 
representations are enabled to be displayed in a corresponding period of time segment 
of the timeline view along with a text identification of an event associated with the 
multiple media file representations. Adcock discloses a calendar based graphical user 
interface for displaying digital images [paragraph 1]. Graphical objects representing 
digital images are displayed within a calendar view having a timeline [figures 4, 5]. 
Digital Images are accessible for detailed viewing or editing by selection of a displayed 
graphical object In the calendar [paragraph 35]. Images for an event may be grouped 
together [paragraph 37] and associated with an event identifier [paragraph 40]. 
Additionally, event groups in the graphical object display window may be 
separated/identified by a placeholder containing information for the associated event 
[paragraph 42]. This allows users to more efficiently browse images [paragraph 3]. 



Application/Control Number: 1 0/71 5,1 87 Page 1 7 

Art Unit: 2173 

Since Vronay discloses the need to better locate and retrieve computer information 
such as files, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to use the interface of Adcock for browsing the calendar-based 
interface of Vronay. This would allow users to more efficiently browse images. 

5-24. Regarding claim 44, Vronay, Temple, and Adcock disclose the method of claim 
22, further comprising automatically correlating the metadata in the digital media file 
with distinct metadata associated with a calendar event created and represented in the 
calendar format independent of any digital media files, by disclosing automatically 
associating digital images with an event or date [Adcock, paragraph 39]. 

Claims 26-31,45 

5-25. Regarding claim 26, Vronay teaches a method comprising: storing information 
related to a calendar event in an event file, the calendar event being manually created 
and visually represented in a calendar independent of any digital media files, by 
disclosing a calendar-based user interface that improves user accessibility of 
information from a computer [paragraph 1]. Users may specify appointments, meetings, 
etc. [paragraph 5] which are marked on the calendar to allow users to easily track 
important events [paragraph 42]. 

Vronay teaches receiving a digital media file associated with the calendar event, 
by disclosing retrieving information about computer files [paragraph 26]. 
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Vronay teaches correlating the digital media file with the information in the event 
file, by disclosing utilizing information stored in a calendar system database as well as 
information determined by similarity and chunking system to display different levels of 
time-based information relating the user computer activities and files [paragraph 33]. 

Vronay teaches creating an accessible representation of the digital media file and 
at least a portion of the correlated information in the event file in a media view, by 
disclosing displaying visualizations to distinguish events [paragraphs 37-43]. Photos 
may be searched for and accessed [paragraphs 48, 65]. 

The calendar view allows for manual entry of future events since standard 
calendar operations are provided [paragraph 35] that include user-specified 
appointments, meetings, etc. to be added or entered manually [paragraph 5]. These 
events are marked on the calendar to allow users to easily track important events 
[paragraph 42]. The user computer activities may be in the future [paragraph 38]. The 
user computer activity must involve manual creation as described in [paragraphs 35, 5] 
since if monitoring of events is strictly done without user input and based solely on data 
collection of activities carried out on a computing device, there would be no way for the 
computer to create future events. 

Although Vronay discloses that events are marked on the calendar to allow users 
to easily track important events [paragraphs 39-42], Vronay does not expressly teach 
the calendar view including at least one manually entered past event. Temple discloses 
adding appointments to a calendar in Microsoft Outlook 2000 [page 196, Adding an 
Appointment]. Users can enter the date and time for an appointment, which may be a 
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past date [page 198, When?; page 200, Other Ways to Add Appointments]. Since 
Vronay discloses providing and including standard calendar operations, similar to the 
calendar in numerous conventional calendar programs [Vronay, paragraph 35], it would 
have been obvious to one of ordinary skill in the art at the time the invention was made 
to allow users to manual enter an event in the past, as taught by Temple. This would 
provide added flexibility in scheduling events. 

Although Vronay discloses simultaneously presenting the calendar view with a 
list of times and corresponding accessible media [Vronay, paragraph 65, figure 11], 
Vronay does not expressly teach the media view being generated in a timeline view that 
combines the media view with a calendar view such that multiple media file 
representations are enabled to be displayed in a corresponding period of time segment 
of the timeline view along with a text identification of an event associated with the 
multiple media file representations. Adcock discloses a calendar based graphical user 
interface for displaying digital images [paragraph 1]. Graphical objects representing 
digital images are displayed within a calendar view having a timeline [figures 4, 5]. 
Digital images are accessible for detailed viewing or editing by selection of a displayed 
graphical object in the calendar [paragraph 35]. Images for an event may be grouped 
together [paragraph 37] and associated with an event identifier [paragraph 40]. 
Additionally, event groups in the graphical object display window may be 
separated/identified by a placeholder containing information for the associated event 
[paragraph 42]. This allows users to more efficiently browse images [paragraph 3]. 
Since Vronay discloses the need to better locate and retrieve computer information 
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such as files, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to use the interface of Adcock for browsing the calendar-based 
interface of Vronay. This would allow users to more efficiently browse images. 

5-26. Regarding claim 27, Vronay, Temple, and Adcock disclose the method of claim 
26, wherein the storing information related to a calendar event in an event file further 
comprises storing information related to a calendar event in an event file associated 
with a calendar planner of a media diary, by disclosing creating events for a calendar- 
based interface [Vronay, paragraph 5]. 

5-27. Regarding claim 28, Vronay, Temple, and Adcock disclose the method of claim 
26, wherein the creating an accessible representation of the digital media file and at 
least a portion of the correlated information in the event file further comprises creating, 
in a media view of the media diary, an accessible representation of the digital media file 
and at least a portion of the correlated information in the event file, by disclosing 
displaying visualizations to distinguish events [Vronay, paragraphs 37-43]. Photos may 
be searched for and accessed [Vronay, paragraphs 48, 65]. 

5-28. Regarding claim 29, Vronay, Temple, and Adcock disclose the method of claim 
26, wherein the storing information related to a calendar event in an event file further 
comprises storing date and event title information related to a calendar event in an 
event file, by disclosing distinguishing between events [Vronay, paragraph 37]. 
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5-29. Regarding claim 30, Vronay, Temple, and Adcock disclose the method of claim 
26, wherein the correlating the digital media file with the information in the event file 
further comprises correlating metadata in the digital media file with date information in 
the event file, by disclosing associating computer files with events [Vronay, paragraphs 
33-35]. 

5-30. Regarding claim 31 , Vronay, Temple, and Adcock disclose the method of claim 
26, wherein the correlating the digital media file with the information in the event file 
further comprises correlating metadata in the digital media file with distinct metadata 
information in the event file, by disclosing associating computer files with events 
[Vronay, paragraphs 33-35]. 

5-31 . Regarding claim 45, Vronay, Temple, and Adcock disclose the method of claim 
30, wherein the correlating the digital media file with the information in the event file 
includes automatically correlating the digital media file with the information in the event 
file, by disclosing automatically integrating time-based information with metadata 
tagging [Vronay, paragraph 6]. 

Claims 32-36, 46 

5-32. Regarding claim 32, Vronay discloses a method comprising: receiving a media 
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file having associated metadata information, by disclosing retrieving information about 
computer files [paragraph 26]. 

Vronay teaches correlating the metadata information with calendar event 
information relating to a calendared event created manually and visually represented in 
a calendar independent of any digital media files, by disclosing that users may specify 
appointments, meetings, etc. [paragraph 5/ which are marked on the calendar to allow 
users to easily track important events [paragraph 42]. Information stored in a calendar 
system database is utilized as well as information determined by similarity and chunking 
system to display different levels of time-based information relating the user computer 
activities and files [paragraph 33]. 

Vronay teaches determining a manner in which the media file will be represented 
in a media view of the media diary and presenting the media file as a media file 
representation in the media view in accordance with the correlation procedure and the 
determination of the manner of representation, by disclosing that photos may be 
searched for and presented as shown in [figures 5-11]. 

The calendar view allows for manual entry of future events since standard 
calendar operations are provided [paragraph 35] that include user-specified 
appointments, meetings, etc. to be added or entered manually [paragraph 5]. These 
events are marked on the calendar to allow users to easily track important events 
[paragraph 42]. The user computer activities may be in the future [paragraph 38]. The 
user computer activity must involve manual creation as described in [paragraphs 35, 5] 
since if monitoring of events is strictly done without user input and based solely on data 
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collection of activities carried out on a computing device, there would be no way for the 
computer to create future events. 

Although Vronay discloses that events are marked on the calendar to allow users 
to easily track important events [paragraphs 39-42], Vronay does not expressly teach 
the calendar view including at least one manually entered past event. Temple discloses 
adding appointments to a calendar in Microsoft Outlook 2000 [page 196, Adding an 
Appointment]. Users can enter the date and time for an appointment, which may be a 
past date [page 198, When?; page 200, Other Ways to Add Appointments]. Since 
Vronay discloses providing and including standard calendar operations, similar to the 
calendar in numerous conventional calendar programs [Vronay, paragraph 35], it would 
have been obvious to one of ordinary skill in the art at the time the invention was made 
to allow users to manual enter an event in the past, as taught by Temple. This would 
provide added flexibility in scheduling events. 

Although Vronay discloses simultaneously presenting the calendar view with a 
list of times and corresponding accessible media [Vronay, paragraph 65, figure 11], 
Vronay does not expressly teach the media view being generated in a timeline view that 
combines the media view with a calendar view such that multiple media file 
representations are enabled to be displayed in a corresponding period of time segment 
of the timeline view along with a text identification of an event associated with the 
multiple media file representations. Adcock discloses a calendar based graphical user 
interface for displaying digital images [paragraph 1]. Graphical objects representing 
digital images are displayed within a calendar view having a timeline [figures 4, 5]. 
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Digital images are accessible for detailed viewing or editing by selection of a displayed 
graphical object in the calendar [paragraph 35]. Images for an event may be grouped 
together [paragraph 37] and associated with an event identifier [paragraph 40]. 
Additionally, event groups in the graphical object display window may be 
separated/identified by a placeholder containing information for the associated event 
[paragraph 42]. This allows users to more efficiently browse images [paragraph 3]. 
Since Vronay discloses the need to better locate and retrieve computer information 
such as files, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to use the interface of Adcock for browsing the calendar-based 
interface of Vronay. This would allow users to more efficiently browse images. 

5-33. Regarding claim 33, Vronay, Temple, and Adcock disclose the method of claim 
32, wherein the determining the manner in which the media file will be represented in a 
media view of the media diary further comprises determining the size of a thumbnail 
representing the media file, by disclosing that as the views are enlarged, the 
arrangement of graphical objects within each calendar day is updated to take advantage 
of the available display space [Adcock, paragraph 35]. 

5-34. Regarding claim 34, Vronay, Temple, and Adcock disclose the method of claim 
32, wherein the determining the manner in which the media file will be represented in a 
media view of the media diary further comprises determining a size of a date column 
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that the representation will reside in, by disclosing that calendar views are resized 
based on the number of digital images [Adcock, paragraph 46]. 

5-35. Regarding claim 35, Vronay, Temple, and Adcock disclose the method of claim 
32, wherein the determining the manner in which the media file will be represented in a 
media view of the media diary further comprises determining the size of the media view 
in proportion to the overall viewing area, by disclosing that calendar views are resized 
based on the number of digital images [Adcock, paragraph 46]. 

3-36. Regarding claim 36, Vronay, Temple, and Adcock disclose the method of claim 
32, wherein the determining the manner in which the media file will be represented in a 
media view of the media diary further comprises determining a quantity of the media 
files represented in a date column, by disclosing that as the views are enlarged, the 
arrangement of graphical objects within each calendar day is updated to take advantage 
of the available display space [Adcock, paragraph 35]. The calendar views are resized 
based on the number of digital images [Adcock, paragraph 46]. 

5-37. Regarding claim 46, Vronay, Temple, and Adcock disclose the method of claim 
32, wherein said correlating the metadata information with calendar event information 
includes automatically correlating the metadata information with calendar event 
information, by disclosing automatically associating digital images with an event or date 
[Adcock, paragraph 39]. 
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Claims 37, 40, 41,47 

5-38. Regarding claim 37, Vronay discloses an apparatus comprising: a processor and 
memory including computer program code, the memory and computer program code 
configured to, with the processor, cause the apparatus to at least receive manual input 
creating an event, by disclosing a calendar-based user interface that improves user 
accessibility of information from a computer [paragraph 1]. Users may specify 
appointments, meetings, etc. [paragraph 5/ which are marked on the calendar to allow 
users to easily tracl< important events [paragraph 42]. 

Vronay teaches generating a calendar view that represents time in calendar 
format and visually associates events with respective periods of time, at least one of the 
events being created and represented in the calendar view independent of any digital 
media files, by disclosing displaying visualizations to distinguish events on a calendar 
[paragraphs 37-43]. 

Vronay teaches generating a media view that provides access to digital media 
files and associates digital media files with a period of time, by disclosing that photos 
may be searched for and accessed [paragraph 65]. 

The calendar view allows for manual entry of future events since standard 
calendar operations are provided [paragraph 35] that include user-specified 
appointments, meetings, etc. to be added or entered manually [paragraph 5]. These 
events are marked on the calendar to allow users to easily track important events 
[paragraph 42]. The user computer activities may be in the future [paragraph 38]. The 
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user computer activity must involve manual creation as described in [paragraphs 35, 5] 
since if monitoring of events is strictly done without user input and based solely on data 
collection of activities carried out on a computing device, there would be no way for the 
computer to create future events. 

Although Vronay discloses that events are marked on the calendar to allow users 
to easily track important events [paragraphs 39-42], Vronay does not expressly teach 
the calendar view including at least one manually entered past event. Temple discloses 
adding appointments to a calendar in Microsoft Outlook 2000 [page 196, Adding an 
Appointment]. Users can enter the date and time for an appointment, which may be a 
past date [page 198, When?; page 200, Other Ways to Add Appointments]. Since 
Vronay discloses providing and including standard calendar operations, similar to the 
calendar in numerous conventional calendar programs [Vronay, paragraph 35], it would 
have been obvious to one of ordinary skill in the art at the time the invention was made 
to allow users to manual enter an event in the past, as taught by Temple. This would 
provide added flexibility in scheduling events. 

Although Vronay discloses simultaneously presenting the calendar view with a 
list of times and corresponding accessible media [Vronay, paragraph 65, figure 11], 
Vronay does not expressly teach the media view being generated in a timeline view that 
combines the media view with a calendar view such that multiple media file 
representations are enabled to be displayed in a corresponding period of time segment 
of the timeline view along with a text identification of an event associated with the 
multiple media file representations. Adcock discloses a calendar based graphical user 
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interface for displaying digital images [paragraph 1]. Graphical objects representing 
digital images are displayed within a calendar view having a timeline [figures 4, 5]. 
Digital images are accessible for detailed viewing or editing by selection of a displayed 
graphical object in the ca\en6ar [paragraph 35]. Images for an event may be grouped 
together [paragraph 37] and associated with an event identifier [paragraph 40]. 
Additionally, event groups in the graphical object display window may be 
separated/identified by a placeholder containing information for the associated event 
[paragraph 42]. This allows users to more efficiently browse images [paragraph 3]. 
Since Vronay discloses the need to better locate and retrieve computer information 
such as files, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to use the interface of Adcock for browsing the calendar-based 
interface of Vronay. This would allow users to more efficiently browse images. 

5-39. Regarding claim 40, Vronay, Temple, and Adcock disclose the apparatus of 
claim 37, wherein the processor is further configured to search the calendar view and 
the media view in terms of time period, by disclosing searching based on dates [Vronay, 
figure 5; Adcocl<, paragraph 36]. 

5-40. Regarding claim 41 , Vronay, Temple, and Adcock disclose the apparatus of 
claim 37, further comprising a display in communication with the processor that 
presents, independently, the calendar view and the media view, by disclosing [Adcock, 
figure 7]. 
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5- 41 . Regarding claim 47, Vronay, Temple, and Adcock disclose the apparatus of 
claim 37, wherein said processor is further configured to automatically correlate 
respective metadata information of the media file and calendar events, at least one of 
the calendar events being created and represented in the calendar view independent of 
any digital media files, by disclosing automatically associating digital images with an 
event or date [Adcock, paragraph 39]. 

6. Claim 25 is rejected under 35 U.S.C. 103(a) as being unpatentable over Vronay 
et al (Pub. No. US 2003/0156138 A1), in view of Temple ("The Complete Idiot's Guide 
to Microsoft Outlook 2000", May 1999), in view of Adcock et al (Pub. No. US 
2004/01 251 50 Al ), and further in view of Hullot et al (Pub. No. US 2004/01 09025 Al ). 

6- 1 . Regarding claim 25, Vronay and Adcock disclose the method of claim 22. Vronay 
and Adcock do not expressly teach wherein the providing the user access to the digital 
media file via a timeline view that combines a timeline with the media view and a 
calendar view of calendared events further comprises providing the user access to the 
digital media file via a timeline view that combines a scrollable timeline with the media 
view and a calendar view of calendared events. Hullot discloses a calendar with a 
scrollable timeline as shown in [figure 9]. It would have been obvious to one of ordinary 
skill in the art at the time the invention was made to include a scrollable timeline, as 
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taught by Hullot, in the calendar interface of Vronay and Adcock. This would allow users 
to view times that cannot be fit into the display. 



Response to Arguments 

7. The Examiner acknowledges the Applicant's amendments to claims 1,4,5, 11, 
12, 20, 22, 25, 26, 32, 34, 37, 40, 41, and 47 and the cancellation of claims 2, 23, 24, 
38, and 39. Regarding independent claims 1, 20, 22, 26, 32, and 37, the Applicant 
alleges that Vronay et al (Pub. No. US 2003/0156138 A1), as described in the previous 
Office action, does not explicitly teach, "at least one manually entered event scheduled 
at a future time". Contrary to Applicant's arguments, the calendar user interface system 
would provide and include standard calendar operations, similar to the calendar in 
numerous conventional calendar programs [paragraph 35]. Conventional computer 
calendars allow for user-specified appointments, meetings, etc. to be added or entered 
manually fparaaraph 51 These events are marked on the calendar to allow users to 
easily track important events [paragraph 42]. The user computer activities may be in the 
future [paragraph 38]. The manual creation as described in fparaaraphs 35. 51 must be 
for future events since if monitoring of events is strictly done without user input and 
based solely on data collection of activities carried out on a computing device, there 
would be no way for the computer to create the future events as described in 
(paragraph 381 . 

Applicant alleges that Vronay does not explicitly teach "at least one manually 
entered past event", as has been amended to the claim. Examiner has therefore 
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included tlie prior art of Temple ("The Complete Idiot's Guide to Microsoft Outlook 
2000", May 1999) to teach the limitation. 

Applicant alleges that Vroney does not explicitly teach "multiple media file 
representations that are enabled to be displayed in a corresponding period of time 
segment of the timeline view along with a text identification of an event associated with 
the multiple media file representations". Examiner has therefore rejected independent 
claims 1, 20, 22, 26, 32, and 37 under 35 U.S.C § 103 as being unpatentable over 
Vronay, in view of Temple, and further in view of Adcock et al (Pub. No. US 
2004/01 251 50 A1). 

Applicant alleges that Adcock fails to teach or suggest the media view being 
generated in a timeline view that combines the media view with a calendar view such 
that multiple media file representations are enabled to be displayed in a corresponding 
period of time segment of the timeline view along with a text identification of an event 
associated with the multiple media file representations, the calendar view including at 
least one manually entered past event and at least one manually entered event 
scheduled at a future time", as has been amended to the claim. Contrary to Applicant's 
arguments, Vroany, in view of Temple, and further in view of Adcock disclose the 
claimed limitation. Adcock discloses a calendar based graphical user interface for 
displaying digital images [paragraph 1]. Graphical objects representing digital images 
are displayed within a calendar view having a timeline [figures 4, 5]. Digital images are 
accessible for detailed viewing or editing by selection of a displayed graphical object in 
the calendar [paragraph 35]. images for an event mav be grouped together fparaaraph 
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371 and associated with an event identifier fparapraph 40]. Additionally, event groups in 
the graphical object display window may be separated/identified by a placeholder 
containing information for the associated event fparaaraph 421 . This allows users to 
more efficiently browse images [paragraph 3]. Since Vronay discloses the need to better 
locate and retrieve computer information such as files, it would have been obvious to 
one of ordinary skill in the art at the time the invention was made to use the interface of 
Adcock for browsing the calendar-based interface of Vronay. This would allow users to 
more efficiently browse images. As mentioned above, Temple is used to teach at least 
one manually entered past event. 

Applicant states that dependent claims 2, 4-19, 21 , 25, 27-31 , 33-36, and 40-47 
recite all the limitations of the independent claims, and thus, are allowable in view of the 
remarks set forth regarding independently amended claims 1 , 20, 22, 26, 32, and 37. 
However, as discussed above, Vronay, in view of Temple, and further in view of Adcock 
are considered to teach claims 1, 20, 22, 26, 32, and 37, and consequently, claims 2, 4- 
19, 21 , 25, 27-31 , 33-36, and 40-47 are rejected. 

Conclusion 

8. The prior art made of record on attached form PTO-892 and not relied upon is 
considered pertinent to applicant's disclosure. Applicant is required under 37 C.F.R § 
1 1 1(c) to consider these references fully when responding to this action. The 
documents cited therein teach similar systems for a media application diary. 
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9. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 

§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply Is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action Is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

1 0. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to ALVIN H. TAN whose telephone number is (571 )272- 
8595 . The examiner can normally be reached on Mon-Fri 8:00-4:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Kleu Vu can be reached on 571-272-4057. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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